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Abstract 

We consider the game-theoretic scenario of testing the performance of Fore- 
caster by Sceptic who gambles against the forecasts. Sceptic's current capital 
is interpreted as the amount of evidence he has found against Forecaster. Re- 
porting the maximum of Sceptic's capital so far exaggerates the evidence. We 
characterize the set of all increasing functions that remove the exaggeration. 
This result can be used for insuring against loss of evidence. 
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1 Introduction 

In game-theoretic probability (see, e.g., [S]) Sceptic is trying to prove Forecaster 
wrong by gambling against him: the values of Sceptic's capital /C„ measure the 
changing evidence against Forecaster. It is always assumed that Sceptic's initial 
capital is /Co = li and Sceptic is required to ensure that /C„ > at each time n. 

The evidence, however, can be both gained and lost. When /C„ becomes 
large at some time n. Forecaster's performance begins to look poor, but then JCi 
for some later time i may be lower and make Forecaster look better. Our result 
will show that Sceptic can avoid losing too much evidence, with a modest price 
to pay for this. 

Suppose we exaggerate the evidence against Forecaster by considering not 
the current value /C„ of his capital but the greatest value so far: 

/C* := max/Ci. 

Continuing research started in HI, we show that there are many functions F : 
[1,00) — ?► [0,00) such that: (1) F{y) — >■ cx) as y — ?► 00 almost as fast as y; (2) 
Sceptic's moves can be modified on-line in such a way that the modified moves 
lead to capital 

/C;>F(/C:), n = l,2,.... (1) 

Sceptic who is worried about losing evidence can use a middle approach securing 
him capital c/C„ -I- (1 — c)IC[^ at each time n for a constant c € (0, 1). This way 
he may sacrifice a fraction 1 — c of his capital but gets insurance against losing 
the bulk of his evidence. See Section |3] for details. 

Technically, we characterize the set of increasing functions F for which (II]) 
can be achieved. In [4] a similar result is proved in the framework of measure- 
theoretic probability. The latter corresponds to the case where Sceptic's strategy 
is known in advance (it involves some other simplifying assumptions, such as 
additivity and even cr-additivity, but they are less important in our current 
context). The situation when Sceptic's strategy is known is much easier, and @] 
uses a simple method based on Levy's zero-one law (see [6j for the game-theoretic 
version of Levy's law). The method of this article is completely different and 
is based on the idea of stopping and combining capital processes. This idea 
is known and has been used in, e.g., [2] (Theorem 1, based on Leonid Levin's 
personal communication) and [S] (Lemma 3.1); we show that it gives optimal 
results in our current framework. 

In this article the words such as "positive" and "increasing" will be used in 
the wide sense of the inequalities < and >. The set of real numbers is M and 
the set of natural numbers is N := {1, 2, . . .}. The extended real line [—00, cxo] is 
denoted M, and we use the convention od + (—00) :— cx). If E is some property, 
I[E} is defined to be 1 if S is satisfied and if not. 



2 Calibrating exaggerated evidence 

Our prediction protocol involves four players: Forecaster, Sceptic, Rival Sceptic, 
and Reality. 

Protocol 1 Competitive scepticism 

/Co '■= 1 and /Cq :— 1 
for n = 1, 2, . . . do 

Forecaster announces £„ G E 

Sceptic announces /„ G [0,oo]'^ such that £n{fn) < /C»i-i 

Rival Sceptic announces /^ € [0, oo]'^ such that fn(/^) < ^n-i 

Reality announces x„ G A" 

/Cn := /n(a^n) and /CJ^ := fn{Xn) 
end for 



The parameter of the protocol is a set X, from which Reality chooses her moves; 
E is the set of all "outer probability contents" on X (to be defined momentarily). 
We always assume that X contains at least two distinct elements. The reader 
who is not interested in the most general statement of our result can interpret 
E as the set of all expectation functionals £ : f i~^ J fdP, P being a probability 
measure on a fixed cr-algebra on X; in this case Sceptic and Rival Sceptic are 
required to output functions that are measurable w.r. to that cr-algebra. 

In general, an outer probability content on A" is a function £ : M'^ — >■ M 
(where M'^ is the set of all functions / : A" — >■ M) that satisfies the following four 
axioms: 

1. If /, 5 e 1-^ and / < g, then £{f) < £{g). 

2. If / e 1-^ and c e (0,oo), then £{cf) = c£{f). 

3. If /,5 e 1-^, then £{f + g) < £{f) + £{g). 

4. For each c G M, £(c) = c, where the c in parentheses is the function in M'^ 
that is identically equal to c. 

An axiom of a-subadditivity on [0, cxi]'^ is sometimes added to this list, but we 
do not need it in this article. (And it is surprising how rarely it is needed in 
general: see, e.g., jS].) In our terminology we follow [3] and [B]. Upper previsions 
studied in the theory of imprecise probabilities (see, e.g., [T]) are closely related 
to (but somewhat more restrictive than) outer probability contents. 

Protocol [T] describes a perfect-information game in which Sceptic tries to 
discredit the outer probability contents £n issued by Forecaster as a faithful 
description of how Reality produces x„ e A". The players make their moves 
sequentially in the indicated order. At each step Sceptic and Rival Sceptic 
choose gambles /„ and /^ on how x„ is going to come out, and their resulting 
capitals are /C„ and /C^, respectively. Discarding capital is allowed, but Sceptic 
and Rival Sceptic are required to ensure that /C„ > and /CJ^ > 0, respectively; 
this is achieved by requiring that /„ and f'^ should be positive. 



Let us call an increasing function F : [l,oo) — > [0, oo) a capital calibrator if 
there exists a strategy for Rival Sceptic that guarantees IC^ > F{JC*^) for all n, 
with F(oo) understood to be limj,_j.oo F{y). We say that a capital calibrator F 
dominates a capital calibrator G if F{y) > G{y) for all y G [1, oo). We say that 
F strictly dominates G ii F dominates G and F{y) > G{y) for some y G [1, oo). 
A capital calibrator is admissible if it is not strictly dominated by any other 
capital calibrator. 

Theorem 1. 1. An increasing function F : [l,oo) — > [0,oo) is a capital 
calibrator if and only if 

^d, < 1. (2) 

2. Any capital calibrator is dominated by an admissible capital calibrator. 

3. A capital calibrator is admissible if and only if it is right- continuous and 

Proof. First we prove that any increasing function F : [1, oo) — > [0, oo) satisfying 
F{y)^ f uPidu), V2/e[l,(^), (4) 

for a probability measure P on [l,oo) is a capital calibrator. For each m > 1, 
define the following strategy for Rival Sceptic: at step n, the strategy outputs 

]u otherwise 

as Rival Sceptic's move /^. Let us check that this is a valid strategy, i.e., that 
f«(/«"^) < /Ci"2i, n e N, where /C(") is defined by /c[,"^ := 1 and /ci"' := 
fn (xn) for n e N. There are three cases to consider: 

1. If /C*_i < u, we have /C;"'^ = /C„_i and £n{fn ) = Snifn) < ^«-i = 

(u) 

2. If n is the smallest number for which /C*i_i > u, we have /C„_]^ = /Cn-i > u 
and SnifL"^) ^£n{u) = u< ici% 

3. Otherwise, we have /C„_i — u and so £n(.fn ) = £n{u) = u = /C„_2^. 

Set /;(x) :- 4^^) ft\x)Pidu), x e X; this gives IC'„ = ^^^^ /cl")p(du) when 
we set a; to x„. Let us check that this is a valid strategy for Rival Sceptic, i.e.. 



that Snif'n) ^ ^n-1 foi" ^^ H G N. This is now obvious if £n are expectation 
functionals, and in general we have 

= £n I / (l{/C;_i<«} /n + I{/C;_i>u} -"j P(dM) I 

= f„ ( P((/C:_i,oo))/„ + / uP{Au)\ 



<p((/c:_i,^))/c„_i+ / uP(du) 



= /" /C„_iP(dM) + /" uP(du) + I uP{Au) 

</ lc';:l,Pidu)+ f K.[:l,P{du)+ f K.'^:\P{du) 

J\l,oo) 



The last inequality used the analysis of the three cases above. For small values 
of n, our convention was /Cq :— 1 and lC*_i := 1. Notice that our argument 
only used Axioms [2|44] for outer probability contents; no cr-subadditivity was 
required. This strategy will guarantee 

K = I ICl^^Pidu) > f ICil'^Pidu) > f uP{du) = F{JC:). (5) 

J[l,oo) "'[IX*] "'[IX*] 

We can now finish the proof of the statement "if" in part 1 of the theorem, 
which says that any increasing function F : [l,oo) -^ [0,oo) satisfying ([2]) is a 
capital calibrator. Without loss of generality we can assume that F is right- 
continuous and that ([3| holds. It remains to apply Lemma T] below. 

Let us now check that every capital calibrator satisfies p I . Suppose a capital 
calibrator F violates (|2|. We can decrease F so that, for some a > 1 and N gN, 
it is constant in each interval [a"~^, a"), n — 1, . . . ,N, is zero in [a^, oo), and 
still violates (l2|. Of course, F is still a capital calibrator. The substitution 
X = 1/y shows that J„ _F(l/a::)da; > 1, which can be rewritten as 



a I \a a^ J V a 



F{l){l--]+F{a){---\+--- + Fia^-')i-^--j,]>l. (6) 



Suppose, without loss of generality, that X D {0, 1}, and let Forecaster always 
choose 



Let Sceptic play the strategy of always betting all his capital on 1: /„(1) := 
aKn-i and fn{x) '■= for a: ^ 1. Then /C^ = a" where n is the number of Is 
output by Reality before the first element different from 1 (except that n — N 
if Reality outputs only Is during the first N steps) . Backward induction shows 
that the initial capital /Cq required to ensure /C^ > F{]C*^) must be at least 

f („») (1) % f („-., (i)"' (i 4) + n«"-") (i) "" (i - l 

+ --. + F{a)l(l--)+F{l)(l--]>l; 

a \ a) \ a) 

the inequality follows from ([6]), but we know that it is false as /Cq = 1. 

We have proved part 1 of the theorem. Part 3 is now obvious, and part 2 
follows from parts 1 and 3. D 

The following lemma was used in the proof of Theorem [I] 

Lemma 1. An increasing right- continuous junction F : [l,oo) -^ [0,oo) satis- 
fies (m if and only if (OD holds for some probability measure P on [1, co). 

Proof. Let us first check that the existence of a probability measure P satisfy- 
ing ^ implies ^. We have: 

/ ^d,= / / 4p(d.)d, 

= f f ^dyP{du) - / P{du) - 1. (7) 

J[l,oo) J[u.,oo) y "'[1,00) 

It remains to check that any increasing right-continuous F : [1,cxd) — > [0,oo) 
satisfying ^ satisfies Q for some probability measure P on [l,oo). Let Q be 
the measure on [l,oo) (a-finite but not necessarily a probability measure) with 
distribution function F, in the sense that Q{[l,y]) — F{y) for all y G [l,oo). 
Set P(du) :— {l/u)Q{du). We then have Q, and the calculation (l7| shows that 
the (T-finite measure P must be a probability measure (were it not, we would 
not have an equality in ([3|)). D 



According to (|3|, the functions 

F{y) := ayi-" (8) 

are admissible capital calibrators for any a G (0, 1). 

3 Insuring against loss of evidence 

As we saw in Section [ll there is a simple way to use Theorem [l] for insuring 
against loss of evidence. The following corollary says that it leads to an optimal 
result. 



Corollary 1. Let c > and F : [l,oo 

Rival Sceptic has a strategy ensuring 



) — > [0, oo) be an increasing function. 
K > c/C„ + F(/C:) (9) 



if and only if c and F satisfy 



-^-dy < 1 
y 



(10) 



Proof. Suppose (lOl is satisfied; in particular, c G [0, 1]. Using c/„ + (l — c)/^ as 
Rival Sceptic's strategy, where /„ are Sceptic's moves and /^ are Rival Sceptic's 
moves guaranteeing /C^ > yz:^F{IC*^) (cf. Theorem nl) , we can see that Rival 
Sceptic can guarantee (|9|. 

Now suppose Rival Sceptic can ensure (l9|, but ( |lO| ) is violated. As in the 
proof of Theorem [T] we can decrease F so that, for some a > 1 and A^ S N, it is 
constant in each interval [a"~"'^,a"), n = 1, . . . ,iV, is zero in [a^ ,oo), and still 
violates (10 1. Similarly to (|6]), we have 



Fil) 1 



+ F(a) 



+ --- + F{a"-') 



-yN-l 



> 1 



Suppose X D {0, 1} and define Forecaster's and Sceptic's strategies as before. 
Now backward induction shows that the initial capital /Cq required to ensure 



ICj^ > c/Cjv 



,N 



F{)C*pj) must be at least 



N 



+ F{a 



N-2\ 



+ Fia'') 

, X N-2 

a 



N 



1- 



F(a^-i) 



N-l 



1- 



+ F{a) 



1- 



> c 



F(l)(l- 
1 



1 

a , 
c) = l. 



This contradicts JCn = 1. 



According to (l8| and ([9]), Rival Sceptic can guarantee 
IC'a > cXn + (1 - c)a(/C:)i-" 



n 



(11) 



for any constants c € [0, 1] and a G (0, 1). 

Corollary fl] does not mean that (11) or, more generally, (l9| cannot be im- 
proved; it only says that the improvement will not be significant enough to 
decrease the coefficient in front of /C„. For example, if we do not discard the 
term j,^^, ^-. JCh P{du) in k>\, we will obtain 

/c;>p((/c:,^))/c„+i^(/c:). 

The coefficient P((/C*,(X))) in front of A^„ tends to zero as /C* — > oo. 
In particular, using (12) allows us to improve (111 to 



(12) 



/C; > c/C„ + (1 - c)(l - a)(/C:)-"/C„ + (1 - c)a(/C:)i 
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